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Introduction . , v/^ . ^ ' ' \ 



The 1972^3 USMES evaluation focxxsed on the fdl].owing general ciues^tions: 
(aV^Dia thg USMES program foster problem solving capabilities? 

/ * - ' r 

Did exposure to the USMES curriculum have any eff edt on basic skills 
Jy' 'development in'reading and arithmetic? ' * , 

' .(c) Did the USMES curriculum Ifead to different organization of the class- 
^ ^ \ room arjd a different* pattern of interaction within the ^classroom?- * . 

Spfeci^ic answers to the first two of these questions can be found in other 

repo2*ts. In gXeral it appeared (i) that the USMES cu^lcuium d?.d, indeed, foster 

superior 'problem solving b^ha^^.or in elementary school children, and (ii).fth|,t 

most comparisons of USMES classrooms vrLth control classrooms foimd no' differences 

in the de-o^elopment of basic skills in reading and mathematics. 

* ' ** . ■ 

It is the third question, that relating to classroom organization and iriterac- ^ 

tion, with which this report is concerned. The USMES. curriculum by its very nature 

encourages small group v/ork wi^th students ' interacting with each other more than 

would be the c^se in a no^-USMES classroom. The USMES curriculum was also'"seen as 

encouraging a more fl^bly' organised classroom, one in which there might b^ many 

"changes frbm largfe to ' small group to individual instruction depending upon the in- 

structional nfeeds of the moment. The purpose qf the present inquiry was to ascer- 
. . . ^ -V- 

tain to what extent these intended outcomes materialized in the actual classroom. 

As this report will Show, an USMES classroom has important differences in struc- 
/ture and activity from a non-USr^ES class. Many ^f the intended effects of having 
children become involved w*th a "challenge" are strongly evident. The most dramatic 
differences are the greater amount of small group work in USMES classes, the far 
larger number of ideas added by USMES students during class discussions, and the 
higher incidence of child-child interaction during small group work in USMES classes 
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Me thod ^ . 

(^X Subjects • , 

The sampling unit was ♦the individual .classroom (USMES or control). 
There were thirty USMigS classrooms (fifteen in a National sample and fif- 
teen in a Lansing, MichigaA School District sample) and thirty control or ^ 
non-USMES classes (also fifteen in both the National and the Lansing Dis- 
c; trict samples). The 'control classes were matched in terms of gra^e level 
and school building with the USMES classes, but should not be considered 
care f,ul matches to the experimental units in any very strict sens$. 
The classes in the National sample came from a rajige of socipeconpmic and 
geographic settings. Classes in both samples rahged from grades ofle 
through' six. ' . ^ - . ' ' 

(b) Procedure ./ 

The dat^ was gathered, by trained cla0a5:op7ii, observers using two 

■ ' ' / ■ ' 

classroom environment instruments, one for Jai^ge ^oup and^pn^ for small 
group observation. The instruments were developed, especially for .:^his 
investigation, Vand copies of them are attd^chfed %o this report.. Each ob- 
server was to visit each classrodra — USMES and control— nine times in the 
^ course of the 1972-73 school year: three visits ^.n -the fall, three in the 
winter, and three in the spring,* witl^ the specific dates to be worjted (6ut^ 



by the individual observers and participating teachers. 

The observer, upon entering a> classroom, indicated on the cover sheet 
of the instruments ,the type of classroom organization ih evidence at the 
moment — large (whole) group, sma,ll group, or individual. He/she would then 
use the a]^^opriate scale to record the occurrences of specific behavioo^ 
.for the new type of clack's structure. For example, if' upon entering the • 



class, the observer nolTed that the class Vas forking in small' groups , the 

observer recorded *this and ^proceeded to use the small group scale. If the 

'Ciass then changed to a ^^^^^^ S^o^P organization, the observer noted this 

and sMtched to recording^^^^Kthe .large group scale, ^ 

The large group obsey^feon sqale.Rfa^ seven general classifications 

for . observed behavior. These v/ere: (i) |,responds to teacher *s specific 
* \ - 




question, (ii) adds idea, (iii) re^t^rf^tes idea, (iv) presents Vork: — 

demonstrates, (v) changes subject — makes random comment , (vi) debates~ 

< . ' ' . » . ■ ♦ 

argues and (vii) plays games. , . 

The*-smali group observation ^cale also had sdven general classifica- 
tions of behavior. These were broken down inj^o verbal and non-verbal beha- 
viors. ' The verb'al behaviors were:" (i.) answet*s questions (makes' specific . 



response) , '(ii ) asks questions, (iii)* adds ideas, (iv)\^debates — argues, (v) 
makes other comment. The two*^ fiin- verbal categories were: (i) aids and (ii) 
hinder^. Each instance of these small group behaviors was also classified 
as either. "child-child" or "child-teacher", depending uponwho the partici- 
pants in the interaction were. 
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..Ql^fssroom Structure 
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The infOOTation concerning the i^ypie of classroom structure (i.e., 
the form of instructiphVbeing ufeed) is reported for each grade levels in 
Table 1, where the data from National and the Lansing District s-ample 
have been combined. The data was. obtained by averaging the total frequen- 

ci^s of each structure across the\fall, winter, and spring observation 

'■'\''- 

periods. It was necessary to average these as the observers could not ad- 
here strictly * to the observation schedules. 



In comparing the USMES and tKe control, classes , statistically signifi- 

e^ant differences relative to the frequencies of various classroom structures 

were found at grade levels' tvo through six. In general there ^ was a clear 

tendency for thfe USr^EG clas-ses to be in large groups as often as the control . 

classed, ^d this was true across all grade levels. An examination of the 

"small group'' and "individual" instruction categories revealed that the USMES 
II * 

classes used "small group" instruction very much more frequently, while stu- 
r 

'dents in the control classes were much more likely to be working on an indi- 
vidual basis . . . 

The information about class structure was also analyzed by USMES unit, 
and statistically significant differences were found for the following USMES 

units: Burglar Alarm Design, Pedestrian Crossings, Soft Drink Design, De- 

^C - ^ ^ \ 

signing for Human Proportions, and .Consumer Research. The pattern to be des- 

cribed for these uni'ts was also found in the other Units, but th^ magnitude 

cf the effect in these latter cases was not as pronoiinced. In general, the 

gi^ade level pattern previously reported was also apparent for the units. That 

is, both the USI^ES and control classes used large (i,e,, total) group instruc- 

tion' while the USMES classes used more small group instruction and the control 

Classes used more individ^ual instruction* Two of the units deserve special - 

comment. The Burglar Alarm seemed to be more small group than large group 

oriented, and the reverse was true for Describing People* In^ all' other US^S 

units, inhere' was either equal use of both structures, or large groups were 

used* a little more frequently. ^ , 

. .The data relative to classroom structure were also considered in terms 

of the nitmber of times the classroom structure was altered in the course o'f 
* » - ■ 

the observation period. which was approximately one hour in length. The 



frequencies of change here' reported are for all classes in each of the 
three observation periods — fall, winter, and spring. The actual number of 
changes rajaged from zero to five or more. In comparing the frequenqies of 
structural' changes within the classes, statistic Ally significant differences 
between the; USMES and the control classes were found only for the fall ob- 
servation period in. both the National and Lansing District samples and in 
the summation across all periods for the Lansing District sample. In both 
the ^Rational sample and the Lansing District sample, the fall observations 
indicated that the USMES classes tended to change structure more frequently 
during the observation period, hint this differentiation is not apparent in 
the observations made later in the school year. ^^^^^ 

Combining across both the National and. the Lansing District . samples and 
the three seasonal sets of observations, and using only two categories: (i) 
no change and (ii) one^or more changes, shows that overall, there was a sta- 
tistically significant tendency for the 'USMES class structure to change more 
often than .was the case for the cctntrol units. 

(b) Large Group Observa'tion Scale 

^mile it was found that both the USMES and the control classes uti- 
lized large (i.e., whole or total,) group instruction- to inuch the same^extent, 
the interactions withln'^^his form of instruction were found to be different 
for the USMES and the control classes . These results for the National sample 
are presented in Table 2 while those for tlie Lansing Ditstrict seonple can be 
found in Table 3. The frequencies reported in these tables represent the sum- 
^ati^on of the "behaviors across the three seasonal observation periods. 

As can be seen from the two tables, chi-square analyses of the^ USMES and 
control classes in both' samples yielded statistically significant and sometimes 



very contrasting results. Examination of the frequencies within the inteV- 
action categorie.s themselves yields the follovring results: 

A. 

(1) The frequency of children responding to specific (close-ended) 
questions poded by the teacher is considerably lower, in the USMES 
than in the control classroom. 

(2) Children in the USMES fclassrooms tend to oontributg ideas much, 
more often than do their counterparts in the contrq^ classrooms. 
(This is the largest difference betv/een the two groups.) 

(3) In the Lansing District sample, there v/as a higher incfience of 
reiterating ideas in the control classes* . , ' 

(^4*) In general, ther^was no* difference" between the USMES and the con- . 

trol classes in J^erms of the frequency of children presenting work 

or demonstrating to the whole class, 
^(5) Tl]ere v/^s a much lar^e^r amount of random conversation ^and changing 

of the subject in the control than. in the USMES classrooms. 
(6) There was somewhat more debating and arguing in the USMES classes. 

Cc) Small Group Obseryation Scale ^ 

In the analyses of these data, the USMES and the control classes were 
considered separately. In each case^ the data were examined, to determine if 
differences existed relative to the incidence of the type of interaction (i.e., 
child-child vis a vis child-teacher) within smal^ groups. 

In this analysis, the assessment^ of the relationship between the specific 

small group behavior and the participants, in it yielded statistically signifi- 

* » 

cant results. . In the classes of the National sample', child-child interactions 
were more common in all categories in both USMES and control clataes except — 
iltereatipgly enough — in "answers questions" , ^here in the control clashes the 
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child -teacher mode was the more frequently boserved. The. sam'e pattern was 
observed relative to the Lansing District sample. ' . 

These data- were also orgEp.i^zed so as to examine directly any different- 
ces between USMES and control classes vrithin.the child-child and teacher- 
child interaction catego!fies. Thi^ comparison can be seen b^Mow in Tables 
^4 and 5 for the National sample and Tables^ 6 and 7 for the Lansing District* 
sample. These comparisons yielded statistically significant results, and 
they indicated that there was more child-child interaction in the USMES than 
in the control groups in all categories except "debates — argues" in the Na- 
tional s'ample. -In terms of child'-teacher interaction, however, the results 
are almost the reverse. The pattern is clearly that the incidence of this 
kind of interaction with'in' small groilips is higher in the control than in the 
USrffiS "units. 

In the brief description of the observation instruments given above, it 
was indicated that the smG^l^ group ♦ol:5servat ion scale had both verbal and non- 
verbal observation categories. ,Th^ data presented above, however, has been 
limited to the verbal categories. ,^^^alysis of the non-verbal behaviors was 
not possible du^ tu the extremely iinfrequent use of these categories by thp 
classroom observers . Nevertheless , if on a conceptual level, the^ategorjr remain 

■ I J 

potentially fruitful. Therefore, in future instrument development, it will be 
given further attention. | • ' , V 

Conclusion ; ' . 

There were several strong diffe^rences between the USMES jand control class 
which emerged in this study; # 

(l) Although bo*;h USMES and control classes exhibit extensive use of 
whole-group instruction, departures from this traditional mode were decidedly 
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more in the direction of. small-group organization for the USMES classes 
while they were in the direction of individual 'Work for the control classes. 

(5) There vras some evidence that the .USMES classfes change cladsrooiji 
structure more often than ^he control classes • In particular, during the 
fail observation series, there were more ch^tngj^j^ for the USMES classes than 
for the control classes. , ,^ - 

iZ) ^Withih the wholes-group mode, the USMES classes were characterized 
by higher levels of contributing ideas and debating and by lower levels of 
responding to closed-ended teacher quastidns, reiterating of ideas% and ran- 
dom cohversation. The amount of .contributing of ideas by students in USMES 
classtes was papticularly striking. - # '~ ' 

[U] Within the small-grou^ mode, the USMES classes were characterized 
by, more child-child and less child-teacher interaction. 

Thus, the' results of the classroom observations indicated that not only 
are the USMES classes structured differenMy than the control classes, but 
they are also characterized by differing types of interaction within the form 
of instructional organization being used. 
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» Table 1 ' 



Froqiioncy of •Classroom Structures 
by Grade Levol: National ^ 
and. Lansinc Samples 



Grade Level 


Group 


Whole 
^roup 


Structure 
Small Individ^s\ 
Group 1 


Small/ 
{ Individ, 


f 

• 


^ 6 


USMES 
Contrpl 


50 ' 


35 
10 


. 9 * 
20 


12 


12 . 85* 


5 


USMES 
Control 


19 

19. . 


13 


5 

1 V 


2 
2 


12.12* 
(3) 




USMES 
Control 


20 


19 ' 
3 - 


6 • 
20 


2 
0 


21.5/f* 
(3) 


3 


USMES 
Control 




28 

■ 4 


5 . 
19 


Ik 
12 


27.i^2* 
(3) 


2 


USI-!E3 


15 




1 


0 


7.70»- 
(2) 




Control 


21 


0 


6 


0 


•1 


US MBS' 
i Coi^rol* 


■•'3 . 

1+ - 


1 

1 


2 
0 


. 0- 

0 


' 2.07' 


2/3 *** 


USMES 
Control 


11 

3 , 


2 

5 - - 


7 
3 


^0 

1 . 


6 . 80 ' 
(3) 


4/5/6**?- 


U3MES 
Control 


- 9 ' ' 

9 


1 


1 
1 


0 

0. 


2.11 

(2) 



statistically sif^iificant at the five percent 
figures in --iJar en theses are the associated, degrees of freedom 
children at -the^-grade levels - indicated were combined in^ a single 
classroom 



Table 



'?requGnGi^ of Spcific Behaviors^ in 
I^rge^x-oup Observationc : 
National iiample . 



Behavior 



'Group 
OSMES Control 



Rec'pondo to 

Teacher' Question 310 

Adds Ideas. - 1083 

Reiterates Idea 69 

Pre G e nts v/br k- 

Demonstrates ^7 

Changes Subject- 
Random Comment . 19^ 

Debates-Arsues 2^ 

Game-' . . 1 



730 

69 

12 

387 
12 
2 



Chi Square (df=6) = 427;33 * 



statistically significant at ,th'e five ^percent level 



. f 



y ■ 



7 



Table 3 



Frequency of Specif id* Behaviors in 

- Xargo Group Observations: ^ 
' ' \ iansing Sample" 



Behavior 



\ • ^ 'Group : 
USMES Control 



Responds to 
Teacher Question 

Adds Ideas 

Reiterates ' Idea 

Presents v/ork^ 
Demonstratas. 

Chan^<;c3 Subject- 
Rand oh Coranent 

Debates-Argues 
Game" 



338 
1085 
262 

^3 

•7 
4- 



373 

78 

8iJ-8 
2 

■ ' 2 



J 



Chi Square (df = 6) = I66.96 



s'taUstically signif i.Ga^ at the i;iYe percent 
.level .. , " 
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Table; 4 ^ 

. Frequency of V.crbal B^xiiavrofc in 
Snail Groups! ChiM-ChilcT 
Ifi'tGractio'na.. J Wa'tiona.l 

Staple. ■ ,' --v ' 



• 

Behavior - 


1 ■ 

"'/'';< — ■ ■ ■ ■ 

Group 


Control 


Answers QuG-^tions 






Asks Questions 
r 




18? 


Adds Id6a§\ 


/1682 


302 


Debates-Arkues 




...31 


Other Comments /' 

/■ 


. 326 . . " '■ 


124 



stati 



Chi So uaro (df =4 ) - 3^56 , 35 ^ 
Gtically sisnifrcant a-^ the f iv- 



fiVG percent level 



^Table ^ . ' \^\^ 

Frequency of VorbalVBehaiviofs in 
Srr.all Gmups : Child-Teacher 
Interqctiona i National 
Sample 



Bahavio] 



Group 



Control 



Anav/crs Questions 
Asks "^Qucs'tions 
Adds Ideas 
Debates-Air rjues 
Other Comments ' 



83 
^61 
162 
1 



0 
17 



\ Chi SniKircfdr^O ^ ?fi .(^h ' . \ 

statist-ioaily sicrxixicant ""at the five percent level 



Table 5 



^ Frcquoncv of Ver^aJ. .Bel:iaviors in 
Srp.all Groups: Child-Chi'ld^ 
Intoractionn t,Ji;Snsinc 



Behavior 



Group 





■ Control 




c 91 






1129 


216 








375 



AnDv/Grs Question'J 
AckG. QucGtions 
Addd'/^idoas 
Debates Ar^^jues 
Other Corcniar.tG 

C hi Ciaar'-^(df=^0 = 2 53.62 » ' 



statiG|iccLily 'ci,;;nii'icant at the i'lve percent level ■ 

' Table 6r - , 

Frequo:1cy of Verbal Behaviors m . 

Sraall ':-r6urG: Child-Teachor ^ 
Inter actionem i'"* Lansing 

sample . • • , 



Be^aa.-ior^ 


U3MES 


Group 


Control 


AnGv;ers QueationG 


•'67 




129 


A.Gks QuGGtions 




'/ 


• 65 


Adds Ideas 


85 






Debates-Argues ' 


■ 0 




1 . 


Other eomraron'ts 


^19 




63 



Chi Square (Jf^) '= 16^ 59-^ ■ • . 

statiGcicaily sijpiificant at the five percent level 
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\}Sm^ OBSERVATION REPORT 



Date 



Class 



Observer 
Unit 



Sphool_ 



USMES or Control 



r General Reorganizations of Class a ' ■ 

■ * . " ■ 

Total Croup + + • -f + + + + 
• Small^Gr^ups + + + v* + + 4.' ^ 
Individuals + + +* - + + + + N 
' Time ' — — : ' " 



\ 



* 1 



Observer's Notes and I/mtsre salons i 



.0 i 



,4. » i 



\ 
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OBSERVATION OF CLASS DISCUSSION 



Page 



DATE 



4 



aAss 



UNIT 



TIME: START 



7 



END 



CATEGORY 


OCCURENCES {JtLVi) 


1. Responds to 

teacher's specific 
n uea t ion 




2. Adds Idea 





3*1 Reiterates 
Idea . 


• 


4. Presents work*- 
'Demotiat rates 


— 


3. Changes subject 
makes ^random 
comment 




6, Debate- \^ 
Argument 




7. Gime/ 

ft- 


f 



PURPOSE OF CLASS DISCUS SION_ 
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I- 



i\iALL GROUP QBSERVATION FORM 



/ 7;;/. ' "A 



P^ge 



( 



' IN. :.HACir ...): / TI^'.l:^ .Stdtt 



END 







CH ILD-TEACHRR 


'"'iKes spe ll -- r» ♦ 


r 


ri \ , — J : 




^ ~1 

1 ■ - 




■ , '• ' 1 


t 

f 


r- — ' - - ' . ' 

j3 Adds idea 




1 

rt - ■ ■ . 




j^* . Debates— ar?;ut :. 

t ' . ' 


1 , r 


> 


j con;r,ent 


1 ■ . ■ ■ ■ . • , _ 


1 '., ' ■ . ' - 


!:^v-»n -verbal : . * 


• . - ' ^ 
— ^ 


^ •- 

•"r. Aias 






[7 . Hinders . ^ - 

t • ■ ■* ' . 

t 

1 1 -r-^ '-^ 
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